Check a prototype of 2nd version of this platform
being developed by cKnowledge.org in collaboration with
MLCommons.
reproduce program.experiment.speedup
ck-action:reproduce program.experiment.speedup (v3.0.0)
License: BSD 3-clause (code) and CC BY-SA 4.0 (data)
Creation date: 2015-04-03
Source: GitHub
cID: 081173242a88bc94:42bee21643b9829a
Don't hesitate to get in touch if you encounter any issues or would like to discuss this community project!
Creation date: 2015-04-03
Source: GitHub
cID: 081173242a88bc94:42bee21643b9829a
Description
- Automation framework: CK
- Development repository: ck-ml
- Source: GitHub
- How to get the stable version via the CK client:
pip install cbench
cb download module:program.experiment.speedup --version=3.0.0 --all
ck reproduce program.experiment.speedup --help - How to get the development version:
pip install ck
ck pull repo:ck-ml
ck reproduce program.experiment.speedup --help
- How to run from Python:
import ck.kernel as ck
r=ck.access({'action':'',
'module_uoa':'',
... See JSON API below ...
})
if r['return']>0: return r
...
- Module description: example of a script to reproduce and crowdsource experiments: checking program speedups vs a set of compiler flags vs a few data sets
- API Python code: Link
- JSON API:
" Input: { program_uoa - program UOA to check (cmd_key) - cmd key (dataset_uoas) - check dataset UOA (choices) - dict['flags'] - list of combinations of compiler flags (host_os) - host OS (detect, if omitted) (target_os) - OS module to check (if omitted, analyze host) (device_id) - device id if remote (such as adb) (stat_repeat) - max statistical repetitions (4 by default) (check_speedup) - if 'yes', check speedups for the first two optimizations ... (add_to_pipeline) - add this dict to pipeline (force_record) - if 'yes', force record even if behavior expected ... (experiment_repo_uoa) - repo to record experiments (by default "remote-ck") (experiment_remote_repo_uoa) - if above repo is remote, repo on remote server to record experiments (by default "upload") (experiment_uoa) - CK entry UOA to record experiments (by default "reproduce-ck-paper-filter-optimization") } Output: { return - return code = 0, if successful > 0, if error (error) - error text if return > 0 } "